A Novel Adaptive Distributed Load Balancing Strategy for Cluster
نویسندگان
چکیده
* This paper is supported by National 863 Hi-Tech R&D Project under grant No.2002AA1Z2102 Abstract with the dramatically increasing of users accessing Internet services, many researchers employed cluster server to provide their Internet services and proposed all kinds of scheduling strategies to address the imbalance among real servers. However, most of them are based on TCP connections and pay little attention to the diversity of requests and real servers. Thus these strategies will lead to serious imbalance if deployed in a heterogeneous cluster. In this paper, we propose a novel adaptive distributed load balancing strategy, called ADLB, to address this problem. Different from the existing solutions, it offers a kind of least delay scheduling method, which implements adaptive scheduling strategy by the TCP-SYN packet delay mechanism and doesn’t require any additional communication among real servers and front-end dispatcher participation. Experimental results show that our technologies can achieve better balance for heterogeneous cluster and provide good scalability.
منابع مشابه
Adaptive Dynamic Data Placement Algorithm for Hadoop in Heterogeneous Environments
Hadoop MapReduce framework is an important distributed processing model for large-scale data intensive applications. The current Hadoop and the existing Hadoop distributed file system’s rack-aware data placement strategy in MapReduce in the homogeneous Hadoop cluster assume that each node in a cluster has the same computing capacity and a same workload is assigned to each node. Default Hadoop d...
متن کاملTask Partitioning and Load Balancing Strategy for Matrix Applications on Distributed System
In this paper, we present a load-balancing strategy (Adaptive Load Balancing strategy) for data parallel applications to balance the work load effectively on a distributed system. We study its impact on computation-hungry matrix multiplication application. The ALB strategy enhances the performance with features such as intelligent node selection, pre-task assignment, adaptive task sizing and bu...
متن کاملAdaptive Load Balancing Policy for Web Server Custer
The paper highlights the significance of open source software for distributed computing environment and proposes an adaptive load balancing model using open source software for distributed computing environment. The load balancing strategies used by the model are based on load of the system. The proposed algorithm uses current load, response ratio and processor utilization of the nodes of the w...
متن کاملFlexSplit: A Workload-Aware, Adaptive Load Balancing Strategy for Media Cluster
A number of technology and workload trends motivate us to consider a new request distribution and load balancing strategy for streaming media cluster. First, in emerging media workloads, a significant portion of the content is short and encoded at low bit rates. Additionally, media workloads display a strong temporal and spatial locality. This makes modern servers with gigabytes of main memory ...
متن کاملCOMET: A communication-efficient load balancing strategy for multi-agent cluster computing
—This paper proposes a new load balancing strategy, called Comet, for fast multi-agent cluster computing. We use a new load index that takes into account the cost of inter-agent communications. Agents with predictable workload are assigned statically to cluster nodes, whereas agents with unpredictable workload are allowed to migrate dynamically between cluster nodes using a creditbased load bal...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005